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(54) Method and apparatus for processing video pictures, especially for false contour effect 
compensation 

(57) With the new plasma display panel technology 
new kinds of arte fa cts can occur in video pictures. 
These artefacts are commonly described as "dynamic 
false contour effect", since they correspond to distur- 
bances of gray levels and colors in the form of an appa- 
rition of colored edges in the picture when the 
observation point on the POP screen moves. According 
to the invention, such an artefact is compensated by 
analyzing the motion in the pictures, assigning to each 
block of a picture a corresponding motion vector and 
performing a re-coding step in which the different sub- 
fields of a pixel are shifted to distribute the sub-fields of 
a pixel more closely on the eye trajectory. 




HQ.7 



a 

LU 



Primed by Xerox (UK) Business Services 
2.16.7/3.6 



SDOCID: <EP_0S78817A1 .}..> 



EPO 978817 A1 

Description 

[0001] The invention relates to a method and apparatus for processing video pictures, especially lor false contour 
effect compensation. 

5 More specifically the invention is closely related to a kind of video processing for improving the picture quality of pictures 
which are displayed on matrix displays like plasma display panels (PDP) or display devices with digital micro mirror 
arrays (DMD). 

Background 

10 

[0002] Although plasma display panels are known for many years, plasma displays are encountering a growing inter- 
est from TV manufacturers. Indeed, this technology now makes ft possible to achieve flat color panels of large size and 
with limited depths without any viewing angle constraints. The size of the displays may be much larger than the classical 
CRT picture tubes would have ever been allowed. 

75 [0003] Referring to the latest generation of European TV sets, a lot of work has been made to improve its picture qual- 
ity. Consequently, there is a strong demand, that a TV set built in a new technology Ike the plasma display technology 
has to provide a picture so good or better than the old standard TV technology. On one hand, the plasma display tech- 
nology gives the possibility of nearly unlimited screen size, also of attractive thickness, but on the other hand, it gener- 
ates new kinds of artefact s which could damage the picture quality. Most of these artefacts are different from the known 

20 art e fac t s occurring on classical CRT color picture tubes. Already due to this different appearance of the artefacts makes 
them more visfole to the viewer since the viewer is used to see the well-known old TV artefacts. 
[0004] The invention deals with a specific new artefact, which is called "dynamic false contour effect" since/ it corre- 
sponds to disturbances of gray levels and colors in the form of an apparition of colored edges in the picture when an 
observation point on the matrix screen moves. This kind of artefact is enhanced when the image has a smooth grada- 

25 tion like when the skin of a person is being displayed (e. g. displaying of a face or an arm, etc.)- in adcfition, the same 
problem occurs on static images when observers are shaking their heads and that leads to the conclusion that such a 
failure depends on the human visual perception and happens on the retina of the eye. 

[0005] Two approaches have been discussed to compensate for the false contour effect. As the false contour effect 
is directly related to the sub-field organization of the used plasma technology one approach is to make an optimization 

30 of the sub-field organization of the plasma display panels. The sub^field organization will be explained in greater detail 
below but for the moment it should be noted that it is a kind of decomposition of the 8-bit gray level in 8 or more lighting 
sub-periods. An optimization of such a picture encoding will have, indeed, a positive effect on the false contour effect. 
Nevertheless, such a solution can only slightly reduce the false contour effect amplitude but in any cases the effect will 
still occur and will be perceivable. Furthermore, sub-field organization is not a simple matter of design choice The more 

35 sub-fields are allowed the more complicated will the plasma display panel be. So, optimization of the sub-field organi- 
zation is only possible in a narrow range and will not eliminate this effect alone 

[0006] The second approach for the solution of above-mentioned problem is known under the expression "pulse 
equalization technique". This technique is a more complex one. It utilizes equalizing pulses which are added or sepa- 
rated from the TV signal when disturbances of gray scales are foreseen. In addition, since the fact that the false contour 
40 effect is motion relevant, we need different pulses for each possible speed. That leads to the need of a big memory stor- 
ing a number of big look-up tables (LUT) for each speed and there is a need of a motion estimator. Furthermore, since 
the false contour effect depends on the sub-field organization, the pulses have to be re-calculated tor each new sub- 
field organization. However, the bid cfisadvantage of this technique results from the fact that the equalizing pulses add 
failures to the picture to compensate for a failure appearing on the eye retina. Additionally, when the motion is increas- 
es ing in the picture, there is a need to add more pulses to the picture and that leads to conflicts with the picture contents 
in rase of very fast motion. 

Invention 

so [0007] Therefore, it is an object of the present invention to cfisclose a method and an apparatus which achieves an 
efficient false contour effect compensation without affecting the picture content and which is easy to implement This 
object is achieved by the measures claimed in claims 1 and 6. 

[0008] According to the claimed solution in claim 1 , the compensation of the false contour effect is made by utilizing 
a motion estimator which determines motion vectors for blocks of pixel data. The resulting motion vectors are utilized 
55 for recocfing the pixels of the block wherein in the re-cocfing step a step of shifting the sub-fields of pixels is included. 
The so calculated pixels of the block are used to cf splay the picture instead of displaying the original pixel data Thus, 
the general idea of the invention is to detect the movements in the picture (displacement of the eye focus area) and to 
spread the right sub-field pulses over this displacement in order to be sure that the eye will only perceive the correct 
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information through its movement 

[0009] This solution based on a motion esti ma tor has the big advantage that it will not add false information in the 
picture and, in adcfition, this solution is independent from the picture contents and also from the sub-field organization. 
Further advantages are, that the inventive method allows a complete correction of the false contour effect when the 
5 motion vector is well-known. Also the method is not dependent from the used addressing technique for the plasma dis- 
play panel. With regard to the disclosed specific embodiment, when the addressing or the sub-field organization 
changes, there is only the need to re-calculate the different centers of gravity of the suWields but the algorithm remains 
unchanged. 

[0010] Another important advantage is that the picture noise has no impact on the correction quality. The method 
w according to the invention is simple to implement There is no need of a big memory since it does not need any kind of 
LUTs like the pulse equalization technique. 

[0011] Advantageously, additional embodiments of the inventive method are disclosed in the respective dependent 
claims. 

15 Drawings 

[001 2] Exemplary embodiments of the invention are illustrated in the drawings and are explained in more detail in the 
following description. 
[001 3] In the figures: 

20 

Fig. 1 shows a video picture in which the false contour effect is simulated; 

Fig. 2 shows an illustration for explaining the sub-field organization of a PDP; 

25 Fig. 3 shows an illustration for explaining the false contour effect; 

Fig. 4 illustrates the appearance of a dark edge when a display of two frames is being made in the manner shown 
in Fig. 3: 

30 Fig. 5 shows two different sub-field organization schemes; 

Fig. 6 shows the illustration of Fig. 3 but with sub-field organization according to Fig. 5; 
Fig. 7 shows an illustration for the sub-field shift operation according to the invention; 

35 

Fig. 8 shows the video picture of Fig. 1 with a sub-division in blocks of pixels; 
Fig. 9 shows a specific horizontal pattern of a pixel block; 
40 Fig. 1 0 shows an illustration of the positions of the centers of gravity for the different sub-fields; 

Fig. 1 1 shows an illustration of the effect of suWietd shifts on the horizontal pattern shown in Fig. 9 and 
Fig. 1 2 shows a block diagram of the apparatus according to the invention. 
Exem plary embodiments 
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[001 4] The artefact due to the false contour effect is shown in Fig. 1 . On the arm of the displayed woman are shown 
two dark lines, which e. g. are caused by this false contour effect. Also in the face of the woman such dark lines occur 
so on the right side. 

[001 5] A plasma display panel utilizes a matrix array of discharge cells which could only be switched ON or OFF. Also 
unlike a CRT or LCD in which gray levels are expressed by analog control of the light emission, in a PDP the gray level 
is controlled by modulating the number of light pulses per frame. This time-modulation will be integrated by the eye over 
a period corresponding to the eye time response. When an observation point (eye focus area) cm the PDP screen 
ss moves, the eye will follow this movement Consequently, it will no more integrate the fight from the same cell over a 
frame period (static integration) but it will integrate information coming from different cells located on the movement tra- 
jectory Thus it will mix all the light pulses during this movement which leads to a faulty signal information. This effect 
will new be explained in more detail below. 
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[001 6] In the field of video processing is an 8-bit representation of a luminance level very common. In this case each 
level will be represented by a combination of the following 8 bits: 
2° = 1. 2 1 = 2, 2 2 = 4, 2 s = 8, 2* = 16, 2 5 = 32. 2 6 = 64, 2 7 = 128 

[0017] To realize such a coding scheme with the PDP technology, the frame period will be divided in 8 lighting periods 
5 which are also very often referred to sub-fields, each one corresponding to one of the 8 bits. The number of light pulses 
for the bit 2 1 = 2 is the double of that for the bit 2° - 1 . With a combination of these 8 sub-periods, we are able to build 
said 256 different gray levels. Without motion, the eye of the observer will integrate over about a frame period these sub- 
periods and will have the impression of the right gray level. The above-mentioned sub-field organization is shown in Fig. 
2. 

10 [0018] The light emission pattern according to the sub^field organization introduces new categories of image quality 
degradation corresponding to cfisturbances of gray levels and colors. As already explained, these disturbances are 
defined as so-called dynamic false contour effect since the fact that it corresponds to the appearance of colored edges 
in the picture when an observation point on the PDP screen moves. The observer has the impression of a strong con- 
tour appearing on a homogeneous area like displayed skin. The degradation is enhanced when the image has a smooth 

is gradation and also when the light emission period exceeds several milliseconds. So, in dark scenes the effect is not so 
disturbing as in scenes with average gray level (e.g. luminance values from 32 to 223). 

[0019] In addition, the same problem occurs in static images when observers are shaking the heads which leads to 
the conclusion that such a failure depends on the human visual perception. 

[9020] To better understand the basic mechanism of visual perception of moving images, a simple case will be con- 
20 sidered. Let us assume a transition between the luminance levels 1 28 and 127 moving at a speed of 5 pixel per video 
frame and the eye is following this movement. Rg. 3 shows a darker shaded area corresponding to the luminance level 
128 and a lighter shaded area corresponding to the luminance area level 1 27. The sub-field organization, shown in Rg. 
2 is used for building the luminance levels 128 and 127 as it is depicted on the right side of Rg. 3. The three parallel 
lines in Rg. 3 indicate the direction in which the eye is following the movement The two outer lines show the area bor- 
25 ders where a faulty signal will be perceived. Between them the eye will perceive a lack of liminance which leads to the 
appearance of a dark edge in the corresponding area which is illustrated in Rg. 4. The effect that a lade of luminance 
will be perceived in the shown area is due to the fact that the eye will no more integrate ail lighting periods of one pixel 
when the point from which the eye receives light is in movement. Only part of the light pulses will probably be integrated 
when the point moves. Therefore, there is a lack of corresponding luminance and the dark edge will occur. On the left 
30 side of Rg. 4, there is shown a curve which illustrates the behavior of the eye cells during observing the moving picture 
depicted in Rg. 3. The eye cells having a good distance from the horizontal transition will integrate enough light from 
the corresponding pixels. Only the eye cells which are near the transition will not be able to integrate a lot of light from 
the same pixels. 

[0021] To improve this behavior at first a new sub-field organization is presented which has more sub-fields and 

35 above all has more sub-fields with the same weight. This will already reduce the contouring effect and improve the sit- 
uation. Furthermore, it allows for the inventive correction method which will be explained afterwards. In Rg. 5 two exam- 
pies of new coding schemes are shown. The choice of the optimal one has to be made depending on the plasma 
technology. In the first example there are ten sub-fields used wherein there are four sub-fields having fighting periods 
with a relative duration of 48/256. In the second example there are twelve sub-fields and there are seven sub-fields hav- 

40 ing the relative duration of 32/256. Please note that the frame period has a relative duration of 256/256. 

[0022] In Rg. 6 the result of the new sub-field organization according to the second example of Rg. 5 is shown in case 
of the 128/127 horizontal transition moving at a speed of five pixels per frame. Now, the chance that the corresponding 
eye cells will integrate more similar amounts of lighting periods is increased. This is illustrated by the eye-stimuli inte- 
gration curve at the bottom of Rg. 6 when compared to the eye-stimuli integration curve at the bottom of Rg. 3. 

45 [0023] Now the main idea of the invention is to anticipate the movement in the picture in order to position the different 
bit planes of the moving area on the eye integration trajectory. According to this the different bit planes of a pixel are 
shifted depending on the eye movement to make sure that the eye will receive the right information at the right time dur- 
ing its movement This principle is illustrated in Rg. 7. There it is shown that in the area around the horizontal transition 
the sixth and seventh bit plane is shifted by one pixel to the right, the eighth bit plane is shifted by two pixels to the right 

so and the ninth bit plane is shifted by three pixels to the right. The effect of this is, that the eye wiD integrate all the lighting 
periods of the sixth to ninth bit plane, thus leading to a corresponding luminance value of 128 as shown in the eye-stim- 
uli curve at the bottom of Rg. 7. The result is that no dark area will be perceived. 

[0024] Please note that the illustration is simplified in that respect that the stimuli integration curve is smoothed at the 
border areas of the transition. As a resiit this technique aims to modify the coding of the pixels depending on the 
55 motion amplitude and direction. This technique shows very good result since it makes it possftrfe to remove completely 
the false contour effect when the motion is well detected. In the case of a false motion estimation, since no pulses are 
added to the picture but picture contents are shifted, the picture quality is not disturbed a lot. 

[0025] In the following, the algorithm is descrfced in greater detail. At first, the original picture is segmented in blocks, 
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each of which will have a single motion vector assigned. An example of such a decomposition is shown in Fig. 8. Other 
types of motion-dependent pictures segmentations could be used, since the goal is only to decompose the picture in 
basic elements having a well -defined motion vector. So all motion estimators can be used for the invention, which are 
able to subdivide a picture in blocks and to calculate for each block a corresponding motion vector. As motion estimators 
are well-known from, for example 100 Hz up-conversion technique and also from MPEG coding etc., they are well- 
known in the art and there is no need to describe them in greater detail hera As an example where a motion estimator 
is described which could be used in this invention, it is referred to WO-A-89/08891 . Best to be used are motion estima- 
tors which give precisely the direction of the movement and the amplitude of this movement for each block Since most 
of the plasma display panels are working on RGB component data, benefit could be achieved when for each RGB com- 
ponent a separate motion estimation is being carried out and these three components are combined so that the effi- 
ciency of the motion estimation will be improved. 

[0026] The picture block re-coding step will follow the motion estimation step. In the embodiment of the invention 
described here, there are some simplifying assumptions made: 



is 1 .) The addressing time of the PDP is not taken into account. 

2.) The twelve sub-fields organization scheme shown in example 2 of Fig. 5 is used. 

To illustrate the operation of the picture block re-coding step a simple pattern block moving horizontally at a speed of 7 
pixel per frame is selected as an example. Consider a block 8x8 including a horizontal pattern with the following lumi- 

20 nance values: 16 - 46 - 76 -106 - 136 - 166 - 196 - 226. The coding according to our selected subfield organization is 
the one shown in Fig. 9. In a first step a computation of the new sub-field positions is performed. To each sub-field cor- 
responds a center of gravity (at the position of the middle of the sub-field duration) representing its location in the frame 
period. Note, that the addressing time is not being taken into account here. Fig. 1 0 illustrates the center of gravity posi- 
tions within a frame period, wherein a frame lasts from 0 to 255 relative time units. As plasma displays are addressed 

25 in progressive scan mode (interlace video norms require a previous conversion, here) a video frame lasts 20 ms for 50 
Hz systems. For interlace - progressive scan conversion many solutions are known in the art which can be used hare. 
[0027] The computation of the center of gravity for each sub-field can easily be calculated according to the simple 
formula 
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G(n) m S(n) + Dur(n)/2 

where G(n) represents the center of gravity location of a current sub-field, n represents the current sub-field number, 

S(n) represents the start point of the current sub-field and Dur(n) represents the duration of the sub-field. 

[0028] Having given a motion vector V = (Vx; Vy), the new position of the sub-f ieids will be calculated according to the 

formula 
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in which Dur(F) represents the complete duration of the frame and Ax„ represents the shift of the current subfield in x 
direction and Ay n represents the shift of the current sub-field in y<lirection. In the example where V = (7; 0) the following 
results are found: 
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[0029] Please note, that only the integer parts of the results after rounding are relevant because the minimum sub- 
field shift is one pixel. 

55 [0030] Next the step of shifting the different sub-fields of a pixel in the direction of motion will performed. This shifting 
operation and the end result is shown in Fig. 1 1. On the right side of Fig. 11 it is depicted by which amount the corre- 
spond rrg sub-fields are to be shifted. For example, the first four sub-fields are not shifted in horizontal direction, the fifth 
and sixth suWields are shifted by one pixel in the horizontal direction and the seventh sub-field is shifted by two pixels 
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in the horizontal direction, etc. 

[0031 ] It goes without saying that the same principle will be applied for other speed amplitudes and other directions. 
In case of a more complex motion direction, bit planes will be moved in both directions horizontal and vertical. 
[0032] An apparatus according to the invention is shown in Rg. 12. The apparatus may be integrated together with 

5 the PDP matrix display. It could also be in a separate box which is to be connected with the plasma display panel. Ref- 
erence no. 10 denotes the whole apparatus Reference no. 1 1 denotes the frame memory to which the RGB data is 
input The frame memory 11 is connected to the motion estimator 12. Motion estimator 12 also receives as another 
input the RGB data of the next frame. So it has access to two succeeding frames in order to detect the motion in the 
video pictures. The resulting motion vectors are output to the sub-field-shift-computing unit 13. The resulting sub-field 

10 shifts are output to the correction device 14 in which the pixels are r encoded, wherein sub-fields (SF) of pixels are 
shifted in a direction determined by the motion vector of the block, and corresponding new re-coded RGB data is output. 
[0033] It goes without saying that the blocks shown in Fig. 12 can be implemented with appropriate computer pro- 
grams tor the same function instead. 

[0034] The invention is not restricted to the disclosed embodiments. Various modifications are possible and are con- 
is sidered to fall within the scope of the claims. E.g. a different sub-field organization could be used. 

[0035] All kinds of displays which are controlled by using different numbers of pulses for gray-level control can be used 
in connection with this invention. 



Claims 

so 

1 . Method for processing video pictures, especially for false contour effect compensation, the video picture consisting 
of pixels, the pixels being digitally coded, the digital code word determining the length of the time period during 
which the corresponding pixel of a display is activated, wherein to each bit of a digital code word a certain duration 
is assigned, hereinafter called sutnfield. the sum of the sub-fields according to a given code word determining the 
25 length of the time period during which the corresponding pixel is activated, characterized in that the picture is sub- 
divided in blocks of pixels (B1 , B2). wherein motion vectors (V) are calculated for the blocks of pixels (B1 . B2) and 
wherein the pixels of a block are re-coded, the re-coding step including a step of shifting sub-fields (SF) of pixels in 
a direction determined by the motion vector of the block. 



30 2. Method according to claim 1 , wherein in the re-coding step centers of gravity (CG) of each suWieid (SF) in a frame 
period are used for the calculation of the sub-field shifts (Ax, Ay), the centers of gravity (CG) being calculated 
according to the formula: 
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G(n) » S(n) + Dur(n)/2 

wherein 



G(n) represents the center of gravity location in the frame period; 
n is the current sub-field number, 
40 S(n) represents the start position of the current sub-field; 

and Dur(n) represents the duration of the current sub-field. 

3. Method according to claims 1 or 2, wherein the calculation of the sub-field shifts (Ax,,, Ay„) is made accorcfing to 
the formula: 



Gin) 



Dur(F) ™~"'» Dur{F) 



so wherein 

Ax„ represents the shift of a current sub-field in x-direction; 
Ay n represents the shift of a current sub-field in y-direction; 

Vx is the x-component of the motion vector and Vy is the y-component of the motion vector; 
ss G(n) represents the center of gravity position of the sutnfieid in the frame period; 

n is the current sub-field number and 
Dur(F) is the complete duration of the frama 
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4. Method according to one of the claims 1 to 3, wherein the following sub-field organization is used; 

the frame period is sub-divided in 12 sub-fields, when the frame period has a relative duration of 256 time units, 
then the sub-fields have the following durations: 
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5. Method accenting to one of the claims 1 to 4, wherein each sub-field (SF) corresponds to a specific lighting period 
of the pixel of the video frame. 

30 

6. Apparatus for processing video pictures, especially for false contour effect compensation, the video pictures con- 
sisting of pixels, the pixels being digitally coded, the digital code word determining the length of the time period dur- 
ing which the corresponding pixel of a display is activated, wherein to each bit of a digital code word a certain 
duration corresponds, hereinafter called sub-field, the sum of the sub-fields according to a given code word deter- 

35 mines the length of the time period during which the corresponding pixel is activated, characterized in that the 
apparatus comprises a motion estimator (12) for calculating motion vectors (V) for blocks of pixels (B1, B2) of a 
video frame, the apparatus further comprises a calculation unit (13) for calculating shifts of the sub-fields (SF) of 
the pixels in a block based on the previously calculated motion vectors. 



40 7. Apparatus according to claim 6, the apparatus further comprising a correction unit (1 4) for performing a re-coding 
operation on the pixels of a block based on the previously calculated sub-field shifts. 

8. Apparatus according to claim 6 or 7, the apparatus comprising a matrix display, especially plasma or DMD display. 
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Fig. 6 
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Fig. 7 
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Fig. 8 
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Fig. 11 
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